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Abstract——Problems such as searching for enemy units on a battlefield, detecting smugglers as 
they cross an international border, and skip tracing involve generating plans to employ limited col- 
lection resources to search for moving targets that are trying to avoid detection. This paper presents 
an automated approach for generating plans to search for “elusive agents”. We also describe an 
implementation for the military problem of searching for mobile enemy ground units. The approach 
consists of three steps. First, it uses automated mobility and terrain analysis to hypothesize a set of 
possible movement plans for the targets. These plans are weighted with user-specified and heuristic 
probability estimates. Next, models of the available sensor resources are applied to identify obser- 
vation “windows”. These windows are regions in space and time where the target agents may be 
detected if they are following one of the hypothesized plans. Third, we generate a search plan for 
the available sensor assets (which can be any combination of mobile and fixed sensors) by heuristi- 
cally searching through alternative subsets of the observation windows. Each search plan, defined 
as a temporally-ordered set of observation windows, is evaluated by exercising an automatically- 
constructed Bayesian network that summarizes the results of the terrain, route planning, and sensor 
coverage analysis. An empirical evaluation of this system was performed with results supporting its 
utility. 


Keywords—Moving target search, Probabilistic reasoning, Anytime algorithm, Sensors, Plan- 
ning. 


1. INTRODUCTION 


A veriety of problems involve using limited sensor resources to search for agents who actively 
attempt to avoid detection. Examples include battlefield intelligence collection, border patrol, 
skip tracing, and drug interdiction. We refer to this problem as searching for elusive agents. 
The problera is most difficult when collection resources are very limited relative to the range 
of the options available to the agents that are the target of search (possible routes, departure 
times, movement tactics, etc.). When resources are limited, only a small portion of the target 
agents’ possible locations can be examined, making it imperative to plan the allocation of sensor 
resources effectively. 

We describe an approach to planning the search for elusive agents with a combination of 
terrain and spatial reasoning, sensor performance models, Bayesian networks, and knowledge 
based planning. 
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2. SYSTEM OVERVIEW 


Figure 1 depicts the data flow diagram of our architecture. Figure 2 shows a functional decom- 
position. In both figures, boxes labeled Terrain and Sensor Models are mainly application-specific 
components that result from knowledge engineering to fit the system to the problem at hand. 
The remainder of the components are applicable to most elusive target search problems. This 
section describes these components and how the system fits together. 


Mobility Analysis 


Sensor Coverage Analysis 


Sensor Plan Generation 


Figure 1. Data flow. 
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Figure 2. Functional decomposition. 


The process of generating a search plan begins with a mobility and terrain analysis to identify 
a set of possible routes, schedules, tactics, etc., of the target agent(s). This analysis must be 
consistent with hypothesized agent objectives such as destinations in military planning or possible 
border crossing points in drug interdiction. 

Next, each possible route is examined to identify regions that one of the available sensors can 
accurately search (e.g., high true positive and low false alarm rates). This analysis depends on 
the characteristics of the available sensors and the situation to which they would be applied, such 
as terrain intervisibility, lighting, weather, and so on. High accuracy regions along with estimates 
of the agent(s)’ possible schedule are used to determine possible observation windows for each 
available sensor. The results of this mobility and sensor analysis is encoded in a causally-directed 
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Bayesian network. The network represents the probability that a target agent could be detected 
in « particular area during particular time intervals. 

Sensor plan generation consists of allocating and scheduling movement of sensors among ob- 
servation windows. Sensor plan generation heuristically searches through the space of possible 
sensor plans. For each sensor plan, the characteristics of the observation windows are also sum- 
marized in the Bayesian network, which is used to evaluate the sensor plan. Of course, sensor 
planning must take account of the movement capabilities of the sensor platform. For example, 
in certain military applications, it may not be desirable to fly an unmanned aerial vehicle over 
possible enemy positions. 

The rest of this section describes each of the three major components in detail. 


2.1. Mobility Analysis 


To be tractable, planning the search for elusive agents is based on the constraints on the agents’ 
movement. Elusive agents are assumed to have objectives they are attempting to achieve (i.e., 
destinations), deadlines when the objectives must be attained (e.g., rendezvous with other agents), 
and movement constraints imposed by terrain and their own capability to traverse that terrain. 
Our work concentrates on ground moving targets so the mobility analysis primarily involves 
terrain reasoning. Our approach can be extended to air or water movers, as long as there are 
significant constraints on their movement such as flying the nap of the earth, avoiding certain 
areas, and so on. Our approach is not practical when searching for completely unconstrained 
aircraft. 

The function of mobility analysis is to hypothesize a plausible set of possible agent routes and 
schedules. Several methods can be used to generate these routes and schedules. Markov mobility 
models are the basis of planners that have been developed to plan the search for nonelusive agents 
such as downed aircraft [1]. But Markov models are computationally expensive when planning 
over long time horizons. We have found that a route finder based on the A* search algorithm [2] 
gives good performance over the range of time horizons typical of military applications where 
planning of this sort is useful (hours). The A* route finding approach can also use search heuristics 
based on automated terrain reasoning techniques, such as precomputed “mobility corridors” [3], 
to reduce computation. 

Our prototype system uses a discrete A* route which computes multiple possible routes for each 
target agent. The evaluation function is the sum of a time-based cost estimate plus a penalty 
for traversing the same terrain cells used by previously computed routes. This penalty factor 
tends to make subsequently generated routes different from previously generated routes except 
where movement limitations would make avoiding prior routes too costly in terms of time (or 
simply be infeasible for the vehicles used by the target agent). The effect is to uncover situation- 
specific “choke points” in the terrain. These choke points are obvious candidates for observation, 
provided one has a sensor platform that can get there at the time the target is anticipated to 
be visible. The A* procedure also may be invoked multiple times with objective functions that 
reflect alternative tactics. Tactics typical of the applications we are interested in include: stay 
off roads, maximize use of cover and concealment, minimize time, and so on. The product of the 
routing algorithm is a set of locations likely to be traversed by the agent along with temporal 
distributions for each location. 

This analysis produces a portion of a Bayesian network [4] that includes the alternative ob- 
jectives, plans, and routes, as depicted in the top part of the network in Figure 3. Additional 
nodes may be added to reflect options considered during planning and route generation (alter- 
native tactics, possible delays, etc.). The probabilities in the network are based on user-specified 
prior probabilities on the objectives, tactics, and other factors. The routes generated using these 
different factors are analyzed and the probability that the agent will be in a particular “win- 
dow” (depicted in Figure 3 by the nomenclature “win”) will be a function of the hypothesized 
routes that pass through that window and the probability of each route. 
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Figure 3. Example Bayesian network for evaluating a search plan. 


2.2. Sensor Coverage Analysis 


For each type of available sensor coverage analysis identifies possible observation windows 
for the routes created by the mobility analysis. These windows incorporate both the spatial 
characteristics of the target unit’s movement and the temporal aspect derived from the probability 
distribution of unit velocity along the routes. Each window has the following components: 


1. sensor location, 

2. a spatial extent, or field of view for the sensor, 

3. a start time which is the earliest time that a sensor at the sensor location could “observe” 
possible activity, 

4. an end time when the sensor would no longer expect to observe activity, and 

5. all observations that have been made at that window. 


Note that windows are derived from both target agent’s possible movements and the given 
sensor’s characteristics. Our implementation includes a “sensor model” template that includes 
sensor characteristics such as field of view under different viewing conditions, and the probabilities 
of false positive and false negative detection. The values for these characteristics can be based 
on typical sensor deployments or they can be functions of physical features such as intervisibility, 
time of day, weather conditions, etc. Sensor coverage analysis must be repeated for each type 
of sensor available in a given scenario. For some sensors, the analysis must also be repeated for 
different deployment tactics for a sensing resource, such as different viewing altitudes. 

The example in Figure 4 illustrates the spatial-temporal of our system. Figure 4 shows the 
spatial extent of four hypothesized routes for a target agent (shown in the upper right corner) 
to the objective (in the lower left corner). Each route is designated by a number, and segments 
of the routes are assigned labels to emphasize that some of the routes share common segments. 
Routes 1, 2, and 3 all start to the west over common Segment A, while Route 4 starts to the south 
over Segment F. These segments are the result of spatial choke-point analysis for the routes, and 
reflect that placement of a sensor at a location that can observe the segment. For instance, a 
sensor observing Segment H will be able to observe Routes 2, 3, and 4. 

Not apparent in Figure 4 is that the routes all have a unique temporal extant. Routes that share 
common spatial segments may arrive at that segment at different times. Consider Segment H. 
Assume that the order of arrival in Segment H is Route 3, followed by Route 4, and finally 
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Route 2. Figure 5 shows the temporal permutations for one location associated with the routes 
in Segment H. Each temporal permutation defines a unique window that can be added to the 
search plan. 
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BD HJ2,3,4] 


Figure 4. Routes and segments. 
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Figure 5. Temporal permutations for Segment H. 


Note that segments usually have several possible viewing locations, each with alternative tem- 
poral permutations. Consequently, for each segment there will be windows that reflect several 
viewing locations and times. The procedure for selecting the best windows is described in [5]. 

We are now ready to add the windows to the Bayesian network. Nodes representing the 
possible observation windows, the sensor for each window, and the possible detection states (e.g., 
sensor reports) can be added. Probabilities are assigned based on characteristics of the sensor, 
location of the sensor, time of day, characteristics of the target agent(s), and the general level 
of background “clutter” in the environment (e.g., number of other objects in the general area of 
interest). 


2.3. Sensor Plan Analysis 


Sensor plan analysis is used to develop allocation plans for the sensor assets. The process 
begins with the user specifying a utility function defining information value. Our experimental 
prototype offers two choices for the objective function: maximize probability of detection or 
maximize probability of determining the agent(s)’ destination. These functions could be modified 
for particular applications. For example, either function could be time dependent, where early 
information is more valuable than information collected later. Whatever function is selected, the 
value of the planner’s objective function is calculated as a weighted sum of the product of the 
probability of each evidence state and the utility of the information that could be collected in that 
state. For instance, the probability of a detection is the sum of the product of the probability of 


108 S. A. MUSMAN et al. 


each evidence state and the probability that the agent is at one of the observation windows for 
which the observed value of, i.e., detect@window, is a detection. 

Sensor allocation plans are generated by heuristically searching the observation windows devel- 
oped by sensor coverage analysis. The heuristic search procedure is iterative broadening [6], which 
iterates through a sequence of depth-first searches with increasing beam widths. Sibling nodes 
are ordered in terms of their incremental contribution to the objective function. Consequently, 
the search procedure may be characterized as greedy iterative broadening (GIB). 

The first iteration quickly generates a solution. Subsequent iterations search for better solu- 
tions. Since an initial solution is found quickly, there is always a current best solution available. 
Thus, the planner is an anytime [7]. This is an important characteristic for certain applications, 
where users cannot always wait for an optimal plan to be generated (which could take a very 
long time, since this type of planning is computationally intractable), but would like to have the 
best plan possible. 

A sensor plan is a set of temporally ordered windows for each available sensor. Our process 
of adding observation windows to the plan is atemporal. Each window added reduces the set of 
windows that can still be added to the plan due to constraints on sensor platform movement. 
After no more windows can be added to the plan, the windows are ordered temporally. 

A limitation of Bayesian networks is the amount of computation needed to compute updates 
for large networks. Cooper showed that probabilistic inference using Bayesian networks is N P- 
hard [8]. This limitation is a concern for difficult moving target search problems, since the 
networks needed can contain several thousand nodes. For example, the approach described by 
Hagar and Mintz [9] requires a large parallel computer to provide answers in a reasonable time 
for problems of this scale. One of the main objectives of our work was to find a way to bound 
computation so that the system performs well on a workstation. 

Our system constructs a simplified Bayesian network that computes posterior probabilities 
that approximate the results of using a full network. The more tractable network reflects three 
simplifications. First, we reduce the number of multiply connected nodes by treating each obser- 
vation windows as though it had a unique sensor. To illustrate, in the network shown in Figure 3, 
Sensorl is connected to Windows 1, 2, 4, and 7. In this network, a sensor report at Window 1 
(recorded in det@W1) will update both the probability that Agent 1 is at Window 1, and that 
Sensorl is working properly. The update on the status of Sensorl, in turn, will influence the 
probability that Sensor1 will report a correct result at the other windows. By treating each 
sensor report as though it were coming from a separate sensor, the assessment of sensor accuracy 
for the unexplored windows does not change after each observation. 

The second simplification is to reduce the number of nodes in the network by removing the 
observation window and sensor nodes, and modifying the detection nodes accordingly. Since the 
first simplification gave each detection node unique parents, the sensor and window nodes can be 
“marginalized out” without changing the structure of the rest of the network. 

The third simplification is to only add detection nodes for observation windows that are in a 
sensor plan currently being evaluated. This results in a unique Bayesian network for each sensor 
plan. Figure 6 illustrates the network that results from simplifying the network in Figure 3 for a 
search plan where Sensor1 is applied to Windows 1, 2, and 4; and Sensor2 is applied to Window 5. 

Computation of posterior probabilities in these simplified networks is very rapid, making the 
approach tractable for fairly complicated realistic search problems. This is because there is 
structure in the conditional probability assessments that can be exploited. As illustrated in 
Figure 6, the structure of the Bayesian networks at the “routes” level and above is a tree. The 
conditional probability values in this tree reflects a taxonomic structure, where each state in each 
node has a positive probability for only one conditioning state in the parent node. This makes it 
possible to calculate posterior probabilities as described below. 

In cases when a detection node has only one agent node as an ancestor proceed as follows. 
First, for each detection node state (det@Wi = s) calculate P(det@Wi = s | route;,) for each 
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Figure 6. Simplified Bayesian network for evaluating a search plan. 


route node that is a descendent of the agent node. Second, when detQWi = s is observed, set 
P(route;, | det@Wi = s) x P(det@Wi = s | route; P(route;,). Third, for each state in each node 
above the route level, assign probabilities by summing over the subnode states that are consistent 
with the specified state. Finally after the objectives node is updated, go back down the network 
to update the beliefs for the other agents. 

In case a detection node has more than one agent node ancestor, then one of two procedures 
can be applied. If the parent nodes are mutually exclusive (i.e., the probability that more than 
one agent will be at the window at the same time is zero), then the above procedure is repeated 
once for each agent. If they are not mutually exclusive, then a general purpose Bayesian network 
update algorithm is invoked. 

As a result, except for the circumstance where a plan has two agents meeting in a common 
location during plan execution, the taxonomic structure of the Bayesian network allows for a 
simple one pass calculation of posterior probabilities. 


3. EVALUATION 


We have implemented the processes described above in a prototype called the Area Limitation 
Planning System (ALPS). An empirical evaluation of ALPS was performed to assess three fac- 
tors: how fast the anytime planner’s ongoing solution converged to an optimal search plan; the 
calibration of the probability of detection estimates; and performance against human opponents. 
Each of these are discussed below. 


3.1. Experiment 1: Rate of Convergence to Optimal Search Plan 


As discussed above, the sensor planner in ALPS is an anytime planner. It is designed to quickly 
generate an initial solution and then to continually modify that solution to progressively better 
solutions. Thus, the quality of the plan should increase monotonically with the time available for 
planning. Because the planner will eventually examine all feasible sensor plans, it is guaranteed 
to eventually find the optimal solution. The issue is the rate of convergence. The first experiment 
investigates this issue. 


Method 


16 random test scenarios were created using a digital terrain map for a 60km by 80 km region 
in and around the National Training Center at Fort Irwin, California. The random tests involved 
a single sensor platform looking for a single agent attempting to obtain a single objective. An 
objective consisted of a destination and a deadline when the agent had to arrive. The initial 
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location of the agent, sensor platform, and objective were all chosen to be random points within 
the test region. Distances from the enemy agent to the objective ranged between 15km and 
45km. A time constraint was used for each scenario which required the enemy agent to arrive at 
the destination within 110% to 120% of time taken for the shortest path to the objective. The 
exact percentage value was chosen randomly for each scenario. 

ALPS was applied to each of the 16 problems. Sensor planning continued until all plans in the 
search space were enumerated or a memory constraint was exceeded on the host system. When 
the latter occurred, it usually occurred between two and five hours after sensor planning was 
initiated. 


Results 


Table 1 summarizes the results of the 16 runs. The second and third columns show the time 
and probability of detection value of the first solution. (Note that the time to initial solution also 
included the time required for mobility and sensor coverage analysis.) The remaining columns 
show the obtained probability of detection value at various time points, beginning at two minutes. 
In all but two cases a sensor plan was generated in the first 90 seconds. Furthermore, in 12 of 
the 16 cases the first solution was always within 90% of the maximum-valued plan found. In the 
worst case, the first solution was 78% of the best solution found. Table 2 shows the average plan 
value over time. 


Table 1. Results of Experiment 1. (“> 7200” indicates runs where memory limit was 
exceeded before completing exhaustive search. Always occurred after two hours.) 


Prob. of Prob. of Prob. of Prob. of Prob. of Time 
detect detect detect detect detect finish 


2 min. 5 min. 10 min. 


Table 2. Average probability of detection for sensor plans at different time points. 


10 minutes | Anal | 
sa S s O n o 


Average prob detect 
Average percent of final prob detect 


Discussion of Experiment 1 


These results provide strong support for the hypothesis that the sensor plan generation pro- 
cedure used within ALPS will usually find a near optimal plan within the first few minutes of 
search. These results are consistent with the many informal tests we performed during develop- 
ment. Consequently, we believe that the greedy iterative broadening search procedure we used 
for sensor plan generation will consistently produce near optimal sensor plans quickly. 
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There are however two considerations that circumscribe the range of this conclusion. First, 
rapid convergence to an optimal solution is not a guaranteed property of greedy iterative broad- 
ening search. Consequently, it is possible to construct problems where this search procedure 
converges slowly. We have not attempted to construct such problems. Second, the greedy it- 
erative broadening search procedure only considered options within the search space defined by 
mobility and sensor coverage analysis. Improvements in mobility and/or sensor coverage analy- 
sis (e.g., shorter duration) might result in substantially better plans. Consequently, there is no 
guarantee that there is a sensor plan in the search space explored by GIB search that is anywhere 
near a “true” optimal. 


3.2. Experiment 2 and 3: Accuracy of Probability Estimates 


As noted in Section 2, each sensor plan was evaluated in part by processing a Bayesian network 
to estimate the probability that the sensor plan would detect the elusive agent. Two experiments 
were conducted to evaluate the accuracy of the probability of detection estimates. 


Method for Experiment 2 


397 scenarios were generated randomly using the scenario generation procedure similar to the 
one described in Experiment 1. The only exception was that the parameters describing the region 
of sensor coverage was different—resulting in a higher probability of detection. Once a random 
scenario was defined, the usual ALPS mobility analysis, sensor coverage analysis, and sensor 
planning was performed, but sensor planning was limited to two minutes. 1 

After the sensor plan was generated, 20 possible routes for the elusive agent were generated 
randomly using the following procedure. First, the enemies’ velocity profile was chosen to be 
either full-speed, fast, medium, or slow. Second, the optimal route to the enemy objective was 
altered by adding waypoints to the route. A waypoint is a location on the map that the enemy 
route must pass through. An initial seed location for a waypoint was chosen randomly from the 
set of map locations obtained during the sensor planning choke-point analysis. Then this initial 
seed location was randomly shifted by up to 0.5 km in both latitude and longitude. Thus, some of 
the waypoints selected for the random routes involved locations never considered during mobility 
analysis and sensor planning. A waypoint is added to the enemy route, if passing through it still 
enables the enemy to reach the objective within the scenario’s time limit. Up to 15 waypoints 
were attempted for each randomly generated route, of which up to four waypoints were actually 
used. 

The sensor plan was tested against each of the 20 routes to obtain an observed proportion of 
detection (Obs-prob). 


Results 


For each scenario, ALPS generated a sensor plan and estimated the probability that the sensor 
plan would successfully detect the target agent (Pred-prob). A linear regression analysis compar- 
ing Pred-prob with the proportion of the 20 routes that the sensor detected the agent (Obs-prob). 
The results are shown in Figure 7, where the line depicts a perfectly calibrated predicator. 

Figure 7 suggests a moderate relationship between the predicated and observed probabilities, 
but that low predictions tended to underestimate the observed probabilities while high proba- 
bility predictions tended to be better estimates. However, a deeper analysis suggests that these 
systematic deviations between predicted and observed probabilities may be an artifact of the 
sampling procedure (i.e., the procedure for selecting test scenarios). Specifically, the maximum 


lWe note that in four cases this two minute time limit was too short to generate a workable sensor plan. This 
was probably due to the complexity of the terrain for the various scenarios, or in some cases, it could have simply 
been due to other heavy loads being placed on the CPU performing the test, since the tests were performed on 
several timeshared computers with differing CPUs. 
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Figure 7. Scatter plot and regression equation for Experiment 2. (Line depicts a 
perfectly calibrated predicator.) 


value possible for Obs-prob is 1.0. Whenever Obs-prob is at or near this 1.0, Pred-prob can 
only underestimate Obs-prob. As can be seen on the scatter plot, many of the Obs-prob values 
were at or near 1.0 (In fact, 70 of the 397 scenarios had Obs-prob = 1.0), and the average Obs- 
prob value was .805. This implies that any imperfect predicator of Obs-prob would, on average, 
underestimate high Obs-prob values for this set of test scenarios. 


Method for Experiment 3 


Parameters controlling the speed of the sensor platform and the observation range of the sensors 
were adjusted to reduce the average predicated probability of detection. These parameter settings 
were the same as in Experiment 1. Informal testing indicated an average Pred-prob around .5. 
228 scenarios were generated and evaluated using the same procedure as in Experiment 2. 


Results 


For each scenario, ALPS generated a sensor plan and estimated the probability that the sensor 
plan would successfully detect the target agent (Pred-prob). A linear regression analysis com- 
paring Pred-prob with the proportion of the 20 routes that the sensor detected the agent. The 
results are shown in Figure 8. 

As can be seen, the average predicated probability matched closely the observed probability, 
although there is some variance around the estimate. Specifically, an analysis of the difference 
between the observed and predicted probability has a standard deviation of .148, suggesting a 
90% confidence interval for the observed value of Pred-prob + — .24. 


Discussion of Experiments 2 and 3 


Overall, the results of Experiments 2 and 3 suggest that the predicated probability of detec- 
tion is reasonably calibrated. On average, when the predicated probability is p, and p is not 
extreme (i.e., near 0 or 1), then the expected proportion of detection across_problems will be 
around p. On the other hand, these results do indicate that there is considerable potential for 
improving the accuracy of p. If Obs-prob is interpreted as a more accurate estimate of the “true” 
probability of detect, then the substantial variance of Obs-prob around Pred-prob suggests that 
the predicator can be improved upon. 
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Figure 8. Scatter plot and regression equation for Experiment 3. 


3.3. Experiment 4: Competing against Human Agents 


A common objection to using automated planners in adversarial settings is that the automated 
planner will be predictable, and therefore, subject to outguessing. In this experiment we tested 
ALPS against human subjects to evaluate the extent to which it is possible for people to outguess 


ALPS. 


Method 


SUBJECTS. Ten members of the technical staff of MITRE’s Advanced Information Technology 
Center volunteered to serve as subjects. Each subject had experience in applying artificial intel- 
ligence technology to military application. 


PROCEDURE. Subjects were first given an opportunity to examine the performance of ALPS 
on several example scenarios. In these scenarios, the subjects could see all of the hypothesized 
routes for the elusive agent and the resultant sensor plan. After this, they could interactively 
enter alternative routes for the target agent to attempt to evade the sensor. When they felt they 
were ready, the subjects were then given a common set of ten test scenarios. These ten scenarios 
were generated randomly using the same scenario generation process used in Experiments 1 and 3. 
In each of these tests, the user knew the location of the enemy agent, the location of the agent’s 
objective, and the location of the sensor trying to locate the agent. For each scenario, the user 
was asked to generate from three to five distinct routes to attempt to avoid detection. 


Results 


Figure 9 shows the scatter plot for the average predicted probability of detection over the ten 
scenarios and the proportion of routes where the target agent was detected.” The line in this 
figure is the line of perfect calibration. As can be seen, the predicted probability of detection 
often overestimated the observed proportion of detections. Although there is clearly a positive 
correlation between the predicted and observed probabilities, trained human subjects could avoid 
the sensor more often than predicted. An examination of the difference between Obs-prob and 
Pred-prob showed that on average the predicted probability was .094 higher than the observed 
probability, with a standard deviation .116. 


2Note that the observed proportion (Obs-prob) averages over all the routes generated by the subjects in the ten 
scenarios, where subjects generated three to five routes in each scenario. 
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Figure 9. Scatter plot for Experiment 4. 


Discussion of Experiment 4 


In this experiment, the subjects had an opportunity to develop and test various approaches 
to outguessing the sensor planner. It is not surprising that they found ways to avoid the sensor. 
Indeed, the surprising thing is that even with their experience and knowledge about ALPS they 
could not outguess ALPS consistently. On average the predicted probability was just .094 higher 
than the observed probability. In a more realistic setting the target agent is not likely to have 
extensive knowledge of ALPS operations. Consequently, it seems reasonable that the results of 
Experiment 4 characterize a practical maximum on the extent to which an agent can outguess 


ALPS. 
4. SUMMARY 


We presented an approach and architecture for generating plans to search for elusive agents. 
Our architecture admits different strategies which can be applied to each architectural layer, 
depending on the problem. These are shown in Figure 10. 


Mobility Corridors 
Mobility Analysis A* Routing 
Markov Model 


Typical Sensor Deployment 
Sensor Coverage Analysis Additional Deployment Tactics 


Single Search Heuristic 
Interleaved Heuristics 


Sensor Plan Analysis 


Figure 10. Strategy alternatives at each layer. 


Our solution merges heuristic search procedures with decision theoretic techniques for proba- 
bilistic reasoning. We have found Bayesian networks to be a useful representation upon which to 
build an automated system that develops plans to search for elusive agents. 
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We performed several experiments to evaluate our approach. Overall, the experimental results 
support the contention that the ALPS system, which implements this approach, is reasonably 
accurate in its evaluation of proposed sensor plans, and that the planner in ALPS will usually find 
near optimal sensor plans. Combined, these results suggest that a system such as ALPS can be 
an effective tool for developing plans to search for elusive agents. Of course, the effectiveness of 
ALPS on practical problems will depend on how well the features of that problem are represented. 
Nevertheless these results suggest that for many domains, if the characteristics of that domain are 
properly modeled, then the approach described here will be effective for automatically developing 
plans to find elusive agents. 


Noe 
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